Chapter 10 


The Emergence and Impact of Intelligent Machines 

*** 


Raymond Kurzweil 

Kurzweil Technologies 
Wellesley Hills, Massachusetts, U.S.A. 


The following issues are addressed in this essay. 1 

• Models of Technology Trends: A discussion of why nanotechnology and related advanced 
technologies are inevitable. The underlying technologies are deeply integrated into our 
society and are advancing on many diverse fronts. 

• The Economic Imperatives of the Law of Accelerating Returns: The exponential 
advance of technology, including the accelerating miniaturization of technology, is driven 
by economic imperative, and, in turn, has a pervasive impact on the economy. 


1 . Models of Technology Trends 

A diverse technology such as nanotechnology progresses on many fronts and is comprised of 
hundreds of small steps forward, each benign in itself. An examination of these trends shows that 
technology in which the key features are measured in a small number of nanometers is 
inevitable. I hereby provide some examples of my study of technology trends. 

The motivation for this study came from my interest in inventing. As an inventor in the 1970s, I 
came to realize that my inventions needed to make sense in terms of the enabling technologies 
and market forces that would exist when the invention was introduced, which would represent a 
very different world than when it was conceived. I began to develop models of how distinct 
technologies — electronics, communications, computer processors, memory, magnetic storage, 
and the size of technology — developed and how these changes rippled through markets and 
ultimately our social institutions. I realized that most inventions fail not because they never 
work, but because their timing is wrong. Inventing is a lot like surfing, you have to anticipate and 
catch the wave at just the right moment. 


' This chapter covers much of the material presented at a plenary address of the same title at the London conference on 
Intelligent Motion and Interaction within Virtual Environments. More of Kurzweil’ s writing may be found on the web at: 
http://www.kurzweilai.net/meme/frame.html7mM0 . 
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In the 1980s, my interest in technology trends and implications took on a life of its own, and I 
began to use my models of technology trends to project and anticipate the technologies of future 
times, such as the year 2000, 2010, 2020, and beyond. This enabled me to invent with the 
capabilities of the future. In the late 1980s, I wrote my first book, The Age of Intelligent 
Machines, which ended with the specter of machine intelligence becoming indistinguishable 
from its human progenitors. This book included hundreds of predictions about the 1990s and 
early 2000 years, and my track record of prediction has held up well. 

During the 1990s I gathered empirical data on the apparent acceleration of all information- 
related technologies and sought to refine the mathematical models underlying these observations. 
In The Age of Spiritual Machines (ASM), which I wrote in 1998, 1 introduced refined models of 
technology, and a theory I called “the law of accelerating returns,” which explained why 
technology evolves in an exponential fashion. 

1.1 The Intuitive Linear View versus the Historical Exponential View 

The future is widely misunderstood. Our forebears expected the future to be pretty much like 
their present, which had been pretty much like their past. Although exponential trends did exist a 
thousand years ago, they were at that very early stage where an exponential trend is so flat and so 
slow that it looks like no trend at all. So their lack of expectations was largely fulfilled. Today, in 
accordance with the common wisdom, everyone expects continuous technological progress and 
the social repercussions that follow. But the future will nonetheless be far more surprising than 
most observers realize because few have truly internalized the implications of the fact that the 
rate of change itself is accelerating. 

Most long-range forecasts of technical feasibility in future time periods dramatically 
underestimate the power of future developments because they are based on what I call the 
“intuitive linear” view of history rather than the “historical exponential view.” To express this 
another way, it is not the case that we will experience a hundred years of progress in the twenty- 
first century; rather we will witness on the order of twenty thousand years of progress (at today’s 
rate of progress, that is). 

When people think of a future period, they intuitively assume that the current rate of progress 
will continue for future periods. Even for those who have been around long enough to experience 
how the pace increases over time, an unexamined intuition nonetheless provides the impression 
that progress changes at the rate that we have experienced recently. From the mathematician’s 
perspective, a primary reason for this is that an exponential curve approximates a straight line 
when viewed for a brief duration. It is typical, therefore, that even sophisticated commentators, 
when considering the future, extrapolate the current pace of change over the next 10 years or 100 
years to determine their expectations. This is why I call this way of looking at the future the 
“intuitive linear” view. 

But a serious assessment of the history of technology shows that technological change is 
exponential. In exponential growth, we find that a key measurement such as computational 
power is multiplied by a constant factor for each unit of time (e.g., doubling every year) rather 
than just being added to incrementally. Exponential growth is a feature of any evolutionary 
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process, of which technology is a primary example. One can examine the data in different ways, 
on different time scales, and for a wide variety of technologies ranging from electronic to 
biological, as well as social implications ranging from the size of the economy to human life 
span, and the acceleration of progress and growth applies. Indeed, we find not just simple 
exponential growth, but “double” exponential growth, meaning that the rate of exponential 
growth is itself growing exponentially. These observations do not rely merely on an assumption 
of the continuation of Moore’s law (i.e., the exponential shrinking of transistor sizes on an 
integrated circuit), but is based on a rich model of diverse technological processes. What it 
clearly shows is that technology, particularly the pace of technological change, advances (at 
least) exponentially, not linearly, and has been doing so since the advent of technology, indeed 
since the advent of evolution on Earth. 

Many scientists and engineers have what my colleague Lucas Hendrich calls “engineer’s 
pessimism.” Often an engineer or scientist who is so immersed in the difficulties and intricate 
details of a contemporary challenge fails to appreciate the ultimate long-term implications of 
their own work, and, in particular, the larger field of work that they operate in. Consider the 
biochemists in 1985 who were skeptical of the announcement of the goal of transcribing the 
entire genome in a mere 15 years. These scientists had just spent an entire year transcribing a 
mere one ten-thousandth of the genome, so even with reasonable anticipated advances, it seemed 
to them like it would be hundreds of years, if not longer, before the entire genome could be 
sequenced. Or consider the skepticism expressed in the mid 1980s that the Internet would ever be 
a significant phenomenon, given that it included only tens of thousands of nodes. The fact that 
the number of nodes was doubling every year and there were, therefore, likely to be tens of 
mi llions of nodes ten years later was not appreciated by those who struggled with “state of the 
art” technology in 1985, which permitted adding only a few thousand nodes throughout the 
world in a year. 

I emphasize this point because it is the most important failure that would-be prognosticators 
make in considering future trends. The vast majority of technology forecasts and forecasters 
ignore altogether this “historical exponential view” of technological progress. Indeed, almost 
everyone I meet has a linear view of the future. That is why people tend to overestimate what can 
be achieved in the short term (because we tend to leave out necessary details), but underestimate 
what can be achieved in the long term (because the exponential growth is ignored). 

1.2 The Law of Accelerating Returns 

The ongoing acceleration of technology is the implication and inevitable result of what I call the 
“law of accelerating returns,” which describes the acceleration of the pace and the exponential 
growth of the products of an evolutionary process. This includes technology, particularly 
information-bearing technologies, such as computation. More specifically, the law of 
accelerating returns states the following: 

• Evolution applies positive feedback in that the more capable methods resulting from one 
stage of evolutionary progress are used to create the next stage. As a result, the rate of 
progress of an evolutionary process increases exponentially over time. Over time, the 
“order” of the information embedded in the evolutionary process (i.e., the measure of how 
well the information fits a purpose, which in evolution is survival) increases. 
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A correlate of the above observation is that the “returns” of an evolutionary process (e.g., 
the speed, cost-effectiveness, or overall “power” of a process) increase exponentially over 
time. 

In another positive feedback loop, as a particular evolutionary process (e.g., computation) 
becomes more effective (e.g., cost effective), greater resources are deployed towards the 
further progress of that process. This results in a second level of exponential growth (i.e., 
the rate of exponential growth itself grows exponentially). 

Biological evolution is one such evolutionary process. 

Technological evolution is another such evolutionary process. Indeed, the emergence of the 
first technology-creating species resulted in the new evolutionary process of technology. 
Therefore, technological evolution is an outgrowth of - and a continuation of - biological 
evolution. 

A specific paradigm (a method or approach to solving a problem, e.g., shrinking transistors 
on an integrated circuit as an approach to making more powerful computers) provides 
exponential growth until the method exhausts its potential. When this happens, a paradigm 
shift (a fundamental change in the approach) occurs, which enables exponential growth to 
continue. 

Each paradigm follows an “S-curve,” which consists of slow growth (the early phase of 
exponential growth), followed by rapid growth (the late, explosive phase of exponential 
growth), followed by a leveling off as the particular paradigm matures. 

During this third or maturing phase in the life cycle of a paradigm, pressure builds for the 
next paradigm shift. 

When the paradigm shift occurs, the process begins a new S-curve. 

Thus the acceleration of the overall evolutionary process proceeds as a sequence of S- 
curves, and the overall exponential growth consists of this cascade of S-curves. 

The resources underlying the exponential growth of an evolutionary process are relatively 
unbounded. 

One resource is the (ever-growing) order of the evolutionary process itself. Each stage of 
evolution provides more powerful tools for the next. In biological evolution, the advent of 
DNA allowed more powerful and faster evolutionary “experiments.” Later, setting the 
“designs” of animal body plans during the Cambrian explosion allowed rapid evolutionary 
development of other body organs, such as the brain. Or to take a more recent example, the 
advent of computer-assisted design tools allows rapid development of the next generation 
of computers. 

The other required resource is the “chaos” of the environment in which the evolutionary 
process takes place and which provides the options for further diversity. In biological 
evolution, diversity enters the process in the form of mutations and ever- changing 
environmental conditions, including cosmological disasters (e.g., asteroids hitting the 
Earth). In technological evolution, human ingenuity combined with ever-changing market 
conditions keep the process of innovation going. 



If we apply these principles at the highest level of evolution on Earth, the first step, the creation 
of cells, introduced the paradigm of biology. The subsequent emergence of DNA provided a 
digital method to record the results of evolutionary experiments. Then, the evolution of a species 
that combined rational thought with an opposable appendage (the thumb) caused a fundamental 
paradigm shift from biology to technology. The upcoming primary paradigm shift will be from 
biological thinking to a hybrid combining biological and nonbiological thinking. This hybrid will 
include “biologically inspired” processes resulting from the reverse engineering of biological 
brains. 

If we examine the timing of these steps, we see that the process has continuously accelerated. 

The evolution of life forms required billions of years for the first steps (e.g., primitive cells); 
later on progress accelerated. During the Cambrian explosion, major paradigm shifts took only 
tens of millions of years. Later on, Humanoids developed over a period of millions of years, and 
Homo sapiens over a period of only hundreds of thousands of years. 

With the advent of a technology-creating species, the exponential pace became too fast for 
evolution through DNA-guided protein synthesis and moved on to human-created technology. 
Technology goes beyond mere tool making; it is a process of creating ever more powerful 
technology using the tools from the previous round of innovation, and is, thereby, an 
evolutionary process. The first technological steps — sharp edges, fire, the wheel — took tens of 
thousands of years. For people living in this era, there was little noticeable technological change 
in even a thousand years. By 1000 AD, progress was much faster and a paradigm shift required 
only a century or two. In the nineteenth century, we saw more technological change than in the 
nine centuries preceding it. Then in the first twenty years of the twentieth century, we saw more 
advancement than in all of the nineteenth century. Now, paradigm shifts occur in only a few 
years time. The World Wide Web did not exist in anything l ik e its present form just a few years 
ago; it didn’t exist at all a decade ago. 

MASSUSE OF INVENTIONS 
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The paradigm shift rate (i.e., the overall rate of technical progress) is currently doubling 
(approximately) every decade; that is, paradigm shift times are halving every decade (and the 
rate of acceleration is itself growing exponentially). So, the technological progress in the twenty- 
first century will be equivalent to what would require (in the linear view) on the order of 200 
centuries. In contrast, the twentieth century saw only about 20 years of progress (again at today’s 
rate of progress) since we have been speeding up to current rates. So the twenty-first century will 
see about a thousand times greater technological change than its predecessor. 

1.3 Moore’s Law and Beyond 

There is a wide range of technologies that are subject to the law of accelerating returns. The 
exponential trend that has gained the greatest public recognition has become known as “Moore’s 
Law.” Gordon Moore, one of the inventors of integrated circuits, and then Chairman of Intel, 
noted in the mid-1970s that we could squeeze twice as many transistors on an integrated circuit 
every 24 months. Given that the electrons have less distance to travel, the circuits also run twice 
as fast, providing an overall quadrupling of computational power. 

However, the exponential growth of computing is much broader than Moore’s Law. 

If we plot the speed (in instructions per second) per $1000 (in constant dollars) of 49 famous 
calculators and computers spanning the entire twentieth century, we note that there were four 
completely different paradigms that provided exponential growth in the price-performance of 
computing before the integrated circuits were invented. Therefore, Moore’s Law was not the 
first, but the fifth paradigm to exponentially grow the power of computation. And it won’t be the 
last. When Moore’s Law reaches the end of its S-Curve, now expected before 2020, the 
exponential growth will continue with three-dimensional molecular computing, a prime example 
of the application of nanotechnology, which will constitute the sixth paradigm. 

When I suggested in my book The Age of Spiritual Machines, published in 1999, that three- 
dimensional molecular computing, particularly an approach based on using carbon nanotubes, 
would become the dominant computing hardware technology in the teen years of this century, 
that was considered a radical notion. There has been so much progress in the past four years, 
with literally dozens of major milestones having been achieved, that this expectation is now a 
mainstream view. 
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Moore’s Law was not the first, but the fifth paradigm to provide exponential 
growth of computing. Each time one paradigm runs out of steam, another picks 
up the pace. 

The exponential growth of computing is a marvelous quantitative example of the exponentially 
growing returns from an evolutionary process. We can express the exponential growth of 
computing in terms of an accelerating pace: it took 90 years to achieve the first MIPS (million 
instructions per second) per thousand dollars; now we add one MIPS per thousand dollars every 
day. 

Moore’s Law narrowly refers to the number of transistors on an integrated circuit of fixed size, 
and sometimes has been expressed even more narrowly in terms of transistor feature size. But 
rather than feature size (which is only one contributing factor), or even number of transistors, I 
think the most appropriate measure to track is computational speed per unit cost. This takes into 
account many levels of "cleverness" (i.e., innovation, which is to say, technological evolution). 

In addition to all of the innovation in integrated circuits, there are multiple layers of innovation 
in computer design, e.g., pipelining, parallel processing, instruction look-ahead, instruction and 
memory caching, and many others. 

The human brain uses a very inefficient electrochemical digital-controlled analog computational 
process. The bulk of the calculations are done in the interneuronal connections at a speed of only 
about 200 calculations per second (in each connection), which is about ten million times slower 
than contemporary electronic circuits. But the brain gains its prodigious powers from its 
extremely parallel organization in three dimensions. There are many technologies in the wings 
that build circuitry in three dimensions. Nanotubes, an example of nanotechnology, which is 
already working in laboratories, build circuits from pentagonal arrays of carbon atoms. One 
cubic inch of nanotube circuitry would be a million times more powerful than the human brain. 
There are more than enough new computing technologies now being researched, including three- 
dimensional silicon chips, optical and silicon spin computing, crystalline computing, DNA 
computing, and quantum computing, to keep the law of accelerating returns as applied to 
computation going for a long time. 


153 



As I discussed previously, it is important to distinguish between the “S” curve (an “S” stretched 
to the right, comprising very slow, virtually unnoticeable growth — followed by very rapid 
growth — followed by a flattening out as the process approaches an asymptote) that is 
characteristic of any specific technological paradigm and the continuing exponential growth that 
is characteristic of the ongoing evolutionary process of technology. Specific paradigms, such as 
Moore’s Law, do ultimately reach levels at which exponential growth is no longer feasible. That 
is why Moore’s Law is an S curve. But the growth of computation is an ongoing exponential (at 
least until we “saturate” the Universe with the intelligence of our human-machine civilization, 
but that will not be a limit in this coming century). In accordance with the law of accelerating 
returns, paradigm shift, also called innovation, turns the S curve of any specific paradigm into a 
continuing exponential. A new paradigm (e.g., three-dimensional circuits) takes over when the 
old paradigm approaches its natural limit, which has already happened at least four times in the 
history of computation. This difference also distinguishes the tool making of non-human species, 
in which the mastery of a tool-making (or using) skill by each animal is characterized by an 
abruptly ending S shaped learning curve, versus human-created technology, which has followed 
an exponential pattern of growth and acceleration since its inception. 

1.4 DNA Sequencing, Memory, Communications, the Internet, and Miniaturization 

This “law of accelerating returns” applies to all of technology, indeed to any true evolutionary 
process, and can be measured with remarkable precision in information-based technologies. 
There are a great many examples of the exponential growth implied by the law of accelerating 
returns in technologies, as varied as DNA sequencing, communication speeds, brain scanning, 
electronics of all kinds, and even in the rapidly shrinking size of technology, which is directly 
relevant to the discussion at this hearing. The future nanotechnology age results not from the 
exponential explosion of computation alone, but rather from the interplay and myriad synergies 
that will result from manifold intertwined technological revolutions. Also, keep in mind that 
every point on the exponential growth curves underlying these panoply of technologies (see the 
graphs below) represents an intense human drama of innovation and competition. It is 
remarkable therefore that these chaotic processes result in such smooth and predictable 
exponential trends. 

As I noted above, when the human genome scan started fourteen years ago, critics pointed out 
that given the speed with which the genome could then be scanned, it would take thousands of 
years to finish the project. Yet the fifteen year project was nonetheless completed slightly ahead 
of schedule. 
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Of course, we expect to see exponential growth in electronic memories such as RAM. 
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Notice How Exponential Growth Continued through Paradigm Shifts from 
Vacuum Tubes to Discrete Transistors to Integrated Circuits 


However, growth in magnetic memory is not primarily a matter of Moore’s law, but includes 
advances in mechanical and electromagnetic systems. 
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Exponential growth in communications technology has been even more explosive than in 
computation and is no less significant in its implications. Again, this progression involves far 
more than just shrinking transistors on an integrated circuit, but includes accelerating advances in 
fiber optics, optical switching, electromagnetic technologies, and others. 
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Notice Cascade of “S ” Curves. 

Note that in the above chart we can actually see the progression of “S” curves: the acceleration 
fostered by a new paradigm, followed by a leveling off as the paradigm runs out of steam, 
followed by renewed acceleration through paradigm shift. 

The following two charts show the overall growth of the Internet based on the number of hosts 
(server computers). These two charts plot the same data, but one is on an exponential axis and 
the other is linear. As I pointed out earlier, whereas technology progresses in the exponential 
domain, we experience it in the linear domain. So from the perspective of most observers, 
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nothing was happening until the mid 1990s when seemingly out of nowhere, the World Wide 
Web and email exploded into view. But the emergence of the Internet into a worldwide 
phenomenon was readily predictable much earlier by examining the exponential trend data. 



EXPOIMEIMTIALSCALE doubling time: 12 months 
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Notice how the explosion of the Internet appears to be a surprise from the Linear 
Chart, but was perfectly predictable from the Exponential Chart. 


The most relevant trend to this hearing, and one that will have profound implications for the 
twenty-first century is the pervasive trend towards making things smaller, i.e., miniaturization. 
The salient implementation sizes of a broad range of technologies, both electronic and 
mechanical, are shrinking, also at a double-exponential rate. At present, we are shrinking 
technology by a factor of approximately 5.6 per linear dimension per decade. 
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2. The Economic Imperatives of the Law of Accelerating Returns 

It is the economic imperative of a competitive marketplace that is driving technology forward 
and fueling the law of accelerating returns. In turn, the law of accelerating returns is 
transforming economic relationships. 

The primary force driving technology is economic imperative. We are moving towards nanoscale 
machines, as well as more intelligent machines, as the result of a myriad of small advances, each 
with their own particular economic justification. 

To use one small example of many from my own experience at one of my companies (Kurzweil 
Applied Intelligence), whenever we came up with a slightly more intelligent version of speech 
recognition, the new version invariably had greater value than the earlier generation and, as a 
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result, sales increased. It is interesting to note that in the example of speech recognition software, 
the three primary surviving competitors stayed very close to each other in the intelligence of 
their software. A few other companies that failed to do so (e.g., Speech Systems) went out of 
business. At any point in time, we would be able to sell the version prior to the latest version for 
perhaps a quarter of the price of the current version. As for versions of our technology that were 
two generations old, we couldn’t even give those away. 

There is a vital economic imperative to create smaller and more intelligent technology. Machines 
that can more precisely carry out their missions have enormous value. That is why they are being 
built. There are tens of thousands of projects that are advancing the various aspects of the law of 
accelerating returns in diverse incremental ways. Regardless of near-term business cycles, the 
support for “high tech” in the business community, and in particular for software advancement, 
has grown enormously. When I started my optical character recognition (OCR) and speech 
synthesis company (Kurzweil Computer Products, Inc.) in 1974, high-tech venture deals totaled 
approximately $10 mi llion. Even during today’s high tech recession, the figure is 100 times 
greater. We would have to repeal capitalism and every visage of economic competition to stop 
this progression. 

The economy (viewed either in total or per capita) has been growing exponentially throughout 
this century: 
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Note that the underlying exponential growth in the economy is a far more powerful force than 
periodic recessions. Even the “Great Depression” represents only a minor blip compared to the 
underlying pattern of growth. Most importantly, recessions, including the depression, represent 
only temporary deviations from the underlying curve. In each case, the economy ends up exactly 
where it would have been had the recession/depression never occurred. 

Productivity (economic output per worker) has also been growing exponentially. Even these 
statistics are greatly understated because they do not fully reflect significant improvements in the 
quality and features of products and services. It is not the case that “a car is a car;” there have 
been significant improvements in safety, reliability, and features. Certainly, $1000 of 
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computation today is immeasurably more powerful than $1000 of computation ten years ago (by 
a factor of more thanlOOO). There are a myriad of such examples. Pharmaceutical drugs are 
increasingly effective. Products ordered in five minutes on the web and delivered to your door 
are worth more than products that you have to fetch yourself. Clothes custom-manufactured for 
your unique body scan are worth more than clothes you happen to find left on a store rack. These 
sorts of improvements are true for most product categories, and none of them are reflected in the 
productivity statistics. 

The statistical methods underlying the productivity measurements tend to factor out gains by 
essentially concluding that we still only get one dollar of products and services for a dollar 
despite the fact that we get much more for a dollar (e.g., compare a $1,000 computer today to 
one ten years ago). University of Chicago Professor Pete Klenow and University of Rochester 
Professor Mark Bils estimate that the value of existing goods has been increasing at 1.5% per 
year for the past 20 years because of qualitative improvements. This still does not account for the 
introduction of entirely new products and product categories (e.g., cell phones, pagers, pocket 
computers). The Bureau of Labor Statistics, which is responsible for the inflation statistics, uses 
a model that incorporates an estimate of quality growth at only 0.5% per year, reflecting a 
systematic underestimate of quality improvement and a resulting overestimate of inflation by at 
least 1 percent per year. 

Despite these weaknesses in the productivity statistical methods, the gains in productivity are 
now reaching the steep part of the exponential curve. Labor productivity grew at 1.6% per year 
until 1994, then rose at 2.4% per year, and is now growing even more rapidly. In the quarter 
ending July 30, 2000, labor productivity grew at 5.3%. Manufacturing productivity grew at 4.4% 
annually from 1995 to 1999, durables manufacturing at 6.5% per year. 
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The 1990s have seen the most powerful deflationary forces in history. This is why we are not 
seeing inflation. Yes, it’s true that low unemployment, high asset values, economic growth, and 
other such factors are inflationary, but these factors are offset by the double-exponential trends in 
the price-performance of all information-based technologies: computation, memory, 
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communications, biotechnology, miniaturization, and even the overall rate of technical progress. 
These technologies deeply affect all industries. We are also undergoing massive 
disintermediation in the channels of distribution through the Web and other new communication 
technologies, as well as escalating efficiencies in operations and administration. 

All of the technology trend charts above represent massive deflation. There are many examples 
of the impact of these escalating efficiencies. BP Amoco’s cost for finding oil is now less than $1 
per barrel, down from nearly $10 in 1991. Processing an Internet transaction costs a bank one 
penny, compared to over $1 using a teller ten years ago. A Roland Berger/Deutsche Bank study 
estimates a cost savings of $1200 per North American car over the next five years. A more 
optimistic Morgan Stanley study estimates that Internet-based procurement will save Ford, GM, 
and DaimlerChrysler about $2700 per vehicle. 

It is important to point out that a key implication of nanotechnology is that it will bring the 
economics of software to hardware, i.e., to physical products. Software prices are deflating even 
more quickly than hardware. 


Software Price-Performance Has Also Improved at an Exponential Rate: 
Automatic Speech Recognition Software 
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Current economic policy is based on outdated models that include energy prices, commodity 
prices, and capital investment in plant and equipment as key driving factors, but do not 
adequately model the size of technology, bandwidth, MIPs, megabytes, intellectual property, 
knowledge, and other increasingly vital (and increasingly increasing) constituents that are 
driving the economy. 

Another indication of the law of accelerating returns in the exponential growth of human 
knowledge, including intellectual property. If we look at the development of intellectual property 
within the nanotechnology field, we see even more rapid growth. 


U.S. PATENTS GRANTED 
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None of this means that cycles of recession will disappear immediately. Indeed there is a current 
economic slowdown and a technology-sector recession. The economy still has some of the 
underlying dynamics that historically have caused cycles of recession, specifically excessive 
commitments such as over-investment, excessive capital intensive projects and the overstocking 
of inventories. However, the rapid dissemination of information, sophisticated forms of online 
procurement, and increasingly transparent markets in all industries have diminished the impact 
of this cycle. So “recessions” are likely to have less direct impact on our standard of living. The 
underlying long-term growth rate will continue at a double exponential rate. 

Moreover, innovation and the rate of paradigm shift are not noticeably affected by the minor 
deviations caused by economic cycles. All of the technologies exhibiting exponential growth 
shown in the above charts are continuing without losing a beat through this economic slowdown. 

The overall growth of the economy reflects completely new forms and layers of wealth and value 
that did not previously exist, or least that did not previously constitute a significant portion of the 
economy (but do now): new forms of nanoparticle-based materials, genetic information, 
intellectual property, communication portals, web sites, bandwidth, software, data bases, and 
many other new technology-based categories. 


162 



Another implication of the law of accelerating returns is exponential growth in education and 
learning. Over the past 120 years, we have increased our investment in K-12 education (per 
student and in constant dollars) by a factor of ten. We have a one hundred fold increase in the 
number of college students. Automation started by amplifying the power of our muscles, and in 
recent times has been amplifying the power of our minds. Thus, for the past two centuries, 
automation has been eliminating jobs at the bottom of the skill ladder while creating new (and 
better paying) jobs at the top of the skill ladder. So the ladder has been moving up, and thus we 
have been exponentially increasing investments in education at all levels. 




700,000 


EDUCATION EXPENDITURES IN U.S. 


600,000 

500.000 

400.000 

300.000 

200.000 

100,000 

0 



PERCAPITA U.S. EDUCATION EXPENDITURES 



l l l 

1B90 1910 1030 1350 1970 1 00O 2010 

LINEARSCALE 


3. The Deeply Intertwined Promise and Peril of Nanotechnology and Related 
Advanced Technologies 

Technology has always been a double-edged sword, bringing us longer and healthier life spans, 
freedom from physical and mental drudgery, and many new creative possibilities on the one 
hand, while introducing new and salient dangers on the other. Technology empowers both our 
creative and destructive natures. Stalin’s tanks and Hitler’s trains used technology. We still live 
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today with sufficient nuclear weapons (not all of which appear to be well accounted for) to end 
all mammalian life on the planet. Bioengineering is in the early stages of enormous strides in 
reversing disease and aging processes. However, the means and knowledge will soon exist in a 
routine college bioengineering lab (and already exists in more sophisticated labs) to create 
unfriendly pathogens more dangerous than nuclear weapons. As technology accelerates towards 
the full realization of biotechnology, nanotechnology and “strong” AI (artificial intelligence at 
human levels and beyond), we will see the same intertwined potentials: a feast of creativity 
resulting from human intelligence expanded many-fold combined with many grave new dangers. 

Consider unrestrained nanobot replication. Nanobot technology requires billions or trillions of 
such intelligent devices to be useful. The most cost-effective way to scale up to such levels is 
through self-replication, essentially the same approach used in the biological world. And in the 
same way that biological self-replication gone awry (i.e., cancer) results in biological 
destruction, a defect in the mechanism curtailing nanobot self-replication would endanger all 
physical entities, biological or otherwise. I address below steps we can take to address this grave 
risk, but we cannot have complete assurance in any strategy that we devise today. 

Other primary concerns include “who is controlling the nanobots?” and “who are the nanobots 
talking to?” Organizations (e.g., governments, extremist groups) or just a clever individual could 
put trillions of undetectable nanobots in the water or food supply of an individual or of an entire 
population. These “spy” nanobots could then monitor, influence, and even control our thoughts 
and actions. In addition to introducing physical spy nanobots, existing nanobots could be 
influenced through software viruses and other software “hacking” techniques. When there is 
software running in our brains, issues of privacy and security will take on a new urgency. 

My own expectation is that the creative and constructive applications of this technology will 
dominate, as I believe they do today. However, I believe we need to invest more heavily in 
developing specific defensive technologies. As I address further below, we are at this stage today 
for biotechnology, and will reach the stage where we need to directly implement defensive 
technologies for nanotechnology during the late teen years of this century. 

If we imagine describing the dangers that exist today to people who lived a couple of hundred 
years ago, they would think it mad to take such risks. On the other hand, how many people in the 
year 2000 would really want to go back to the short, brutish, disease-filled, poverty-stricken, 
disaster-prone lives that 99 percent of the human race struggled through a couple of centuries 
ago? We may romanticize the past, but up until fairly recently, most of humanity lived extremely 
fragile lives where one all-too-common misfortune could spell disaster. Substantial portions of 
our species still live in this precarious way, which is at least one reason to continue technological 
progress and the economic enhancement that accompanies it. 

People often go through three stages in examining the impact of future technology: awe and 
wonderment at its potential to overcome age old problems; then a sense of dread at a new set of 
grave dangers that accompany these new technologies; followed, finally and hopefully, by the 
realization that the only viable and responsible path is to set a careful course that can realize the 
promise while managing the peril. 
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This congressional hearing was party inspired by Bill Joy’s cover story for Wired magazine, 
“Why The Future Doesn ’t Need Us ”. Bill Joy, cofounder of Sun Microsystems and principal 
developer of the Java programming language, has recently taken up a personal mission to warn 
us of the impending dangers from the emergence of self-replicating technologies in the fields of 
genetics, nanotechnology, and robotics, which he aggregates under the label “GNR.” Although 
his warnings are not entirely new, they have attracted considerable attention because of Joy's 
credibility as one of our leading technologists. It is reminiscent of the attention that George 
Soros, the currency arbitrager and arch capitalist, received when he made vaguely critical 
comments about the excesses of unrestrained capitalism . 

Joy’s concerns include genetically altered designer pathogens, followed by self-replicating 
entities created through nanotechnology. And if we manage to survive these first two perils, we 
will encounter robots whose intelligence will rival and ultimately exceed our own. Such robots 
may make great assistants, but who's to say that we can count on them to remain reliably friendly 
to mere humans? 

Although I am often cast as the technology optimist who counters Joy’s pessimism, I do share 
his concerns regarding self-replicating technologies; indeed, I played a role in bringing these 
dangers to Bill's attention. In many of the dialogues and forums in which I have participated on 
this subject, I end up defending Joy’s position with regard to the feasibility of these technologies 
and scenarios when they come under attack by commentators who I believe are being quite 
shortsighted in their skepticism. Even so, I do find fault with Joy's prescription: halting the 
advance of technology and the pursuit of knowledge in broad fields such as nanotechnology. 

In his essay, Bill Joy eloquently described the plagues of centuries past and how new self- 
replicating technologies, such as mutant bioengineered pathogens and “nanobots” run amok, may 
bring back long-forgotten pestilence. Indeed these are real dangers. It is also the case, which Joy 
acknowledges, that it has been technological advances, such as antibiotics and improved 
sanitation, which have freed us from the prevalence of such plagues. Suffering in the world 
continues and demands our steadfast attention. Should we tell the millions of people afflicted 
with cancer and other devastating conditions that we are canceling the development of all 
bioengineered treatments because there is a risk that these same technologies may someday be 
used for malevolent purposes? Having asked the rhetorical question, I realize that there is a 
movement to do exactly that, but I think most people would agree that such broad-based 
relinquishment is not the answer. 

The continued opportunity to alleviate human distress is one important motivation for continuing 
technological advancement. Also compelling are the already apparent economic gains I 
discussed above that will continue to hasten in the decades ahead. The continued acceleration of 
many intertwined technologies are roads paved with gold (I use the plural here because 
technology is clearly not a single path). In a competitive environment, it is an economic 
imperative to go down these roads. Relinquishing technological advancement would be 
economic suicide for individuals, companies, and nations. 
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3.1 The Relinquishment Issue 

This brings us to the issue of relinquishment, which is Bill Joy’s most controversial 
recommendation and personal commitment. I do feel that relinquishment at the right level is part 
of a responsible and constructive response to these genuine perils. The issue, however, is exactly 
this: at what level are we to relinquish technology? 

Ted Kaczynski would have us renounce all of it. This, in my view, is neither desirable nor 
feasible, and the futility of such a position is only underscored by the senselessness of 
Kaczynski’s deplorable tactics. There are other voices, less reckless than Kaczynski, who are 
nonetheless arguing for broad-based relinquishment of technology. Bill McKibben, the 
environmentalist who was one of the first to warn against global warming, takes the position that 
“environmentalists must now grapple squarely with the idea of a world that has enough wealth 
and enough technological capability, and should not pursue more.” In my view, this position 
ignores the extensive suffering that remains in the human world, which we will be in a position 
to alleviate through continued technological progress. 

Another level would be to forego certain fields — nanotechnology, for example — that might be 
regarded as too dangerous. But such sweeping strokes of relinquishment are equally untenable. 
As I pointed out above, nanotechnology is simply the inevitable end result of the persistent trend 
towards miniaturization that pervades all of technology. It is far from a single centralized effort, 
but is being pursued by a myriad of projects with many diverse goals. 

One observer wrote: 

“A further reason why industrial society cannot be reformed. . .is that modern technology 
is a unified system in which all parts are dependent on one another. You can’t get rid of 
the “bad” parts of technology and retain only the “good” parts. Take modern medicine, 
for example. Progress in medical science depends on progress in chemistry, physics, 
biology, computer science and other fields. Advanced medical treatments require 
expensive, high-tech equipment that can be made available only by a technologically 
progressive, economically rich society. Clearly you can’t have much progress in 
medicine without the whole technological system and everything that goes with it.” 

The observer I am quoting is, again, Ted Kaczynski. Although one will properly resist Kaczynski 
as an authority, I believe he is correct on the deeply entangled nature of the benefits and risks. 
However, Kaczynski and I clearly part company on our overall assessment on the relative 
balance between the two. Bill Joy and I have dialogued on this issue both publicly and privately, 
and we both believe that technology will and should progress, and that we need to be actively 
concerned with the dark side. If Bill and I disagree, it’s on the granularity of relinquishment that 
is both feasible and desirable. 

Abandonment of broad areas of technology will only push them underground where 
development would continue unimpeded by ethics and regulation. In such a situation, it would be 
the less-stable, less-responsible practitioners (e.g., terrorists) who would have all the expertise. 
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I do think that relinquishment at the right level needs to be part of our ethical response to the 
dangers of 21st century technologies. One constructive example of this is the proposed ethical 
guideline by the Foresight Institute, founded by nanotechnology pioneer Eric Drexler, that 
nanotechnologists agree to relinquish the development of physical entities that can self-replicate 
in a natural environment. Another is a ban on self-replicating physical entities that contain their 
own codes for self-replication. In what nanotechnologist Ralph Merkle calls the “broadcast 
architecture,” such entities would have to obtain such codes from a centralized secure server, 
which would guard against undesirable replication. I discuss these guidelines further below. 

The broadcast architecture is impossible in the biological world, which represents at least one 
way in which nanotechnology can be made safer than biotechnology. In other ways, nanotech is 
potentially more dangerous because nanobots can be physically stronger than protein-based 
entities and more intelligent. It will eventually be possible to combine the two by having 
nanotechnology provide the codes within biological entities (replacing DNA), in which case 
biological entities can use the much safer broadcast architecture. I comment further on the 
strengths and weaknesses of the broadcast architecture below. 

As responsible technologies, our ethics should include such “fine-grained” relinquishment, 
among other professional ethical guidelines. Other protections will need to include oversight by 
regulatory bodies, the development of technology-specific “immune” responses, as well as 
computer assisted surveillance by law enforcement organizations. Many people are not aware 
that our intelligence agencies already use advanced technologies such as automated word 
spotting to monitor a substantial flow of telephone conversations. As we go forward, balancing 
our cherished rights of privacy with our need to be protected from the malicious use of powerful 
21 st century technologies will be one of many profound challenges. This is one reason that such 
issues as an encryption “trap door” (in which law enforcement authorities would have access to 
otherwise secure information) and the FBI “Carnivore” email-snooping system have been 
controversial, although these controversies have abated since 9/11/2001. 

As a test case, we can take a small measure of comfort from how we have dealt with one recent 
technological challenge. There exists today a new form of fully nonbiological self replicating 
entity that didn’t exist just a few decades ago: the computer virus. When this form of destructive 
intruder first appeared, strong concerns were voiced that as they became more sophisticated, 
software pathogens had the potential to destroy the computer network medium they live in. Yet 
the “immune system” that has evolved in response to this challenge has been largely effective. 
Although destructive self-replicating software entities do cause damage from time to time, the 
injury is but a small fraction of the benefit we receive from the computers and communication 
links that harbor them. No one would suggest we do away with computers, local area networks, 
and the Internet because of software viruses. 

One might counter that computer viruses do not have the lethal potential of biological viruses or 
of destructive nanotechnology. This is not always the case; we rely on software to monitor 
patients in critical care units, to fly and land airplanes, to guide intelligent weapons in our current 
campaign in Iraq, and other “mission-critical” tasks. To the extent that this is true, however, this 
observation only strengthens my argument. The fact that computer viruses are not usually deadly 
to humans only means that more people are willing to create and release them. It also means that 
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our response to the danger is that much less intense. Conversely, when it comes to self- 
replicating entities that are potentially lethal on a large scale, our response on all levels will be 
vastly more serious, as we have seen since 9/11. 

I would describe our response to software pathogens as effective and successful. Although they 
remain (and always will remain) a concern, the danger remains at a nuisance level. Keep in mind 
that this success is in an industry in which there is no regulation, and no certification for 
practitioners. This largely unregulated industry is also enormously productive. One could argue 
that it has contributed more to our technological and economic progress than any other enterprise 
in human history. I discuss the issue of regulation further below. 


168 



